Skip to content

GH-563: Make ColumnMetaData.path_in_schema optional#564

Open
etseidl wants to merge 2 commits intoapache:masterfrom
etseidl:deprecate_path_in_schema
Open

GH-563: Make ColumnMetaData.path_in_schema optional#564
etseidl wants to merge 2 commits intoapache:masterfrom
etseidl:deprecate_path_in_schema

Conversation

@etseidl
Copy link
Copy Markdown
Contributor

@etseidl etseidl commented Apr 8, 2026

Rationale for this change

What changes are included in this PR?

Change path_in_schema to optional.

Do these changes have PoC implementations?

Yes.

Closes #563

@etseidl
Copy link
Copy Markdown
Contributor Author

etseidl commented Apr 8, 2026

I hope to have a Java PoC available soon.

@etseidl
Copy link
Copy Markdown
Contributor Author

etseidl commented Apr 8, 2026

Java PoC apache/parquet-java#3470

I've so far confirmed that parquet-cli cat from the Java PoC can read a file lacking path_in_schema generated by arrow-rs.

@etseidl etseidl marked this pull request as ready for review April 9, 2026 17:53
@alamb
Copy link
Copy Markdown
Contributor

alamb commented Apr 10, 2026

I think it is a great idea -- though before merging this I think we should do a formal approval on the mailing list

Copy link
Copy Markdown
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for driving this along @etseidl

@etseidl
Copy link
Copy Markdown
Contributor Author

etseidl commented Apr 10, 2026

I think it is a great idea -- though before merging this I think we should do a formal approval on the mailing list

For sure! 👍 I just wanted to put up a concrete proposal to drive the discussion.

Also, FWIW, I've started on an arrow-cpp PoC. We'll see how far I get 😅

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
@etseidl
Copy link
Copy Markdown
Contributor Author

etseidl commented Apr 10, 2026

C++ PoC apache/arrow#49707

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Make path_in_schema optional

2 participants